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Abstract 

We consider the problem of asymptotic convergence to invariant sets in intercon- 
nected nonlinear dynamic systems. Standard approaches often require that the invari- 
ant sets be uniformly attracting, e.g. stable in the Lyapunov sense. This, however, is 
neither a necessary requirement, nor is it always useful. Systems may, for instance, be 
inherently unstable (e.g. intermittent, itinerant, meta-stable) or the problem statement 
may include requirements that cannot be satisfied with stable solutions. This is often 
the case in general optimization problems and in nonlinear parameter identification 
or adaptation. Conventional techniques for these cases rely either on detailed knowl- 
edge of the system's vector-fields or require boundeness of its states. The presently 
proposed method relies only on estimates of the input-output maps and steady-state 
characteristics. The method requires the possibility of representing the system as an in- 
terconnection of a stable, contracting, and an unstable, exploratory part. We illustrate 
with examples how the method can be applied to problems of analyzing the asymptotic 
behavior of locally unstable systems as well as to problems of parameter identification 
and adaptation in the presence of nonlinear parametrizations. The relation of our 
results to conventional small-gain theorems is discussed. 

Keywords: non-uniform convergence, weakly attracting sets, small-gain theorems, input- 
output stability 



1 Notation 



Throughout the paper we use the following notational conventions. Symbol M denotes the 
field of real numbers, symbol M+ stands for the following subset of M: M+ = {a; G M] a; > 
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0}; N and Z denote the set of natural numbers and its extension to the negative domain 
respectively. 

Let f2 be a set, by symbol S{Q} we denote the set of all subsets of Q. Symbol denotes 
the space of functions that are at least k times different iable; /C denotes the class of all strictly 
increasing functions k, : IR+ IR+ such that k{0) = 0. If, in addition, lim^^oo i^{s) = oo 
we say that k G /Cqo- Further, /Cg (or /Ce,oo) denotes the class of functions of which the 
restriction to the interval [0, cxo) belongs to /C (or /Coo)- Symbol ]CC denotes the class of 
functions /3 : R+ x M+ — >• IR+ such that /5(-, 0) G /C and /9(0, ■) is monotonically decreasing. 

Let X G M'^ and x can be partitioned into two vectors xi G M"^, xi = (xn, . . . 
X2 G W^, X2 = {x2i, . . . , X2p)'^ with q+p = n, then © denotes their concatenation: x = Xi©X2. 

The symbol ||x|| denotes the Euclidian norm in x G M". By L^[to,T] we denote the 
space of all functions f : M+ such that ||f ||oo,[to,T] = sup{||f (t)||, t G [to,^]} < oo, and 

||f ||oo,[io,T] stands for the LJ^[to,T] norm of f(t). Let ^ be a set in and || ■ || be the usual 
Euclidean norm in M". By the symbol ||-||^ we denote the following induced norm: 

II^IU = inf{||x-q||} 

Let A G M+ then the notation ||x||_^^ stands for the following equality: 

ll^ll = / l|x|U-A, ||x|U> A 
" "-^^ 1 0, ||x|U < A 

The symbol |H|_4_^ is defined as follows: 

relto,t] 



2 Introduction 

In many fields of science, from systems and control theory to physics, chemistry, and biology, 
it is of fundamental importance to analyze the asymptotic behavior of dynamical systems. 
Most of these analyses are based around the concept of Lyapunov stability |15], [32], [31], i.e. 
continuity of the flow x(t, xq) : IR+ x M" — > L^[to, oo] with respect to xq [IB], in combination 
with the standard notion of an attracting set [9]: 

Definition 1 A set A is an attracting set iff it is 
i) closed, invariant, and 

a) for some neighborhood V of A and for all Xo G V the following conditions hold: 

x(t,Xo) G V V t > 0; (1) 
lim ||x(t,Xo)|U = (2) 

t — ^oo 

Condition ([T]) in Definition [T] stipulates the existence of a trapping region V which is a 
neighborhood of A. Condition ([2]) ensures attractivity, or convergence to S. Due to condition 
([1]), convergence to A is uniform with respect to xq in the neighborhood of A, i.e. every 
trajectory which starts in V remains in V for t > and converges to ^ at t — oo. 

Although the conventional concepts of attracting set and Lyapunov stability are a power- 
ful tandem in various applications, some problems cannot be solved within this framework. 
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Condition ([T]), for example, could be violated in systems with intermittent, itinerant, or 
meta-stable dynamics. In general the condition does not hold when the system dynamics, 
loosely speaking, is exploring rather than contracting. Such systems appear naturally in the 
context of global optimization. For instance, in [22] finding the global minimum of a differ- 
entiable cost function Q : — > IR+ in a bounded subset fl^ C is achieved by splitting 
the search procedure into a locally attracting gradient Sa, and a wandering part S^'- 



The trace function, T{t), in is supposed to cover (i.e. be dense in) the whole searching 
domain Q^- Even though the results in p2] are purely simulation studies, they illustrate 
the superior performance of algorithms ([3]) in a variety of benchmark problems compared 
to standard local minimizers and classical methods of global optimization. Abandoning 
Lyapunov stability is likewise advantageous in problems of identification and adaptation in 
the presence of general nonlinear parameterization [2S\, in manoeuvring and path searching 
[25] . and in decision making in intelligent systems [29], [30]. Systems with attracting, yet 
unstable invariant sets are relevant for modelling complex behavior in biological and physical 
systems [2]. Last but not least, Lyapunov- unstable attracting sets are relevant in problems 



Even when it is appropriate to consider a system as stable, we may be limited in our 
success in meeting the requirement to identify a proper Lyuapunov function. This is the 
case, for instance, when the system's dynamics is only partially known. Trading stability 
requirements for the sake of convergence might be a possible remedy. Known results in this 
direction can be found in [11], [Hp. 

In all the cases that are problematic under condition ([T]) of Definition [H condition ([2]) - 
convergence of x(t,xo) to an invariant set A, is still a requirement that has to be met. In 
order to treat these cases analytically we shall, first of all, move from the standard concept 
of attracting sets in Definition [1] to one that does not assume that the basin of attraction is 
necessarily a neighborhood of the invariant set A. In other words we shall allow convergence 
which is not uniform in initial conditions. This requirement is captured by the concept of 
weak, or Milnor attraction [T7] : 

Definition 2 A set A is weakly attracting, or Milnor attracting set iff 
i) it is closed, invariant and 

a) for some set V (not necessarily a neighborhood of A) with strictly positive measure 
and for all xq G V limiting relation ^ holds 

Conventional methods such as La Salle's invariance principle [13] or center manifold 
theory [7] can, in principle, address the issue of convergence to weak equilibria. They do so, 
however, at the expense of requiring detailed knowledge of the vector-fields of the ordinary 
differential equations of the model. When such information is not available the system can 

"'^See also [20] where the striking difference between stable and "almost stable" synchronization in terms 
of the coupling strengthes for a pair of the Lorenz oscillators is demonstrated analytically. 

^In the Examples section, we demonstrate how explorative dynamics can solve the problem of simultaneous 
state and parameter observation for a system which cannot be transformed into a canonical adaptive observer 
form [3]. 



ax 

: Tit) = h{t,^{t)}, h:R+x L^[to,t] 




■+ 



(3) 
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be thought of as a mere interconnection of input-output maps. Small-gain theorems |33j.|12j 
are usually efficient in this case. These results, however, apply only under the assumption 
of stability of each component in the interconnection. 

In the present study we aim to find a proper balance between the generality of input- 
output approaches [23] , in the analysis of convergence and the specificity of the funda- 
mental notions of limit sets and invariance that play a central role in [13], [7]. The object 
of our study is a class of systems that can be decomposed into an attracting, or stable, 
component Sa and an exploratory, generally unstable, part Sw Typical systems of this class 
are nonlinear systems in cascaded form 

5a : i = f(x,z), 
S^: z = q(z,x) 

where the zero solution of the x-subsystem is asymptotically stable in the absence of input z, 
and the state of the z-subsystem are functions of ||x(r)||(ir. Even when both subsystems 
in (jlj) are stable and the x-subsystem does not depend on state z, the cascade can still 
be unstable [Ij. We show, however, that for unstable interconnections (jlj), under certain 
conditions that involve only input-to-state properties of Sa and S^, there is a set V in 
the system state space, such that trajectories starting in V remain bounded. The result is 
formally stated in Theorem [TJ In case an additional measure of invariance is defined for 
Sa (in our case a steady-state characteristic), a weak, Milnor attracting set emerges. Its 
location is completely determined by the zeros of the steady-state response of system Sa- 

We demonstrate how this basic result can be used in problems of design and analysis 
of control systems and identification/adaptation algorithms. In particular, we present an 
adaptive observer of state and parameter values for uncertain systems which cannot be 
transformed into a canonic adaptive observer form [3]. In the Examples section we present 
an application of this result to the problem of reconstructing a dynamic model of neuronal 
cell activity. 

The paper is organized as follows. In Section 3 we formally state the problem and provide 
specific assumptions for the class of systems under consideration. Section 4 contains the main 
results of our present study. In Section 5 we provide several corollaries of the main result 
that apply to specific problems. Section 6 contains examples, and Section 7 concludes the 
paper. 



3 Problem Formulation 

Consider a system that can be decomposed into two interconnected subsystems, Sa and S^'- 

Sa : (Ma,Xo) x(t) 

Snj : (m«„Zo) ^ z(t) 

where Ua & Ua ^ Loo[to, cc], G C Loo[to, oo] are the spaces of inputs to Sa and iS^, 
respectively xq G M", zq G represent initial conditions, and x(t) E X C L'^[to,oo], 
z{t) G ^ C [to, oo] are the system states. 

System Sa represents the contracting dynamics. More precisely, we require that Sa is 
input-to-state stabl^ [23j with respect to a compact set A: 

^In general, as will be demonstrated with examples, our analysis can be carried out for (integral) input- 
to-output/state stable systems as well. 



4 



Assumption 1 (Contracting dynamics) 

Sa-. ||x(t)||^</3(||x(to)IU,t-to) + c||n,(t)|U,[to,t], VtoGM+, t>to (6) 
where the function ■) G ICC, and c> is some positive constant. 

The function ■) in specifies the contraction property of the unperturbed dynamics of 
Sa- In other words it models the rate with which the system forgets its initial conditions xq, 
if left unperturbed. Propagation of the input to output is estimated in terms of a continuous 
mapping, c||tia(t)||oo,[to,t]; which, in our case, is chosen for simplicity to be linear. Notice that 
this mapping should not necessarily be contracting. In what follows we will assume that the 
function ■) and constant c are known or can be estimated a-priori. 

For systems Sa, of which a model is given by a system of ordinary differential equations 

X = f^(x,M„), f^(-, ■) G C\ (7) 

Assumption [1] is equivalent, for instance, to the combination of the following propertied: 

1. let Ua(t) = for all t, then set A is Lyapunov stable and globally attracting for ([7]); 

2. for all Ua G Ua and xq G M" there exists a non-decreasing function k, : IR+ ]R_|. : 
k(0) = such that 

inf ^ ||x(t)||_4 < K{\\Ua{t)\\ 

tG[0,oo) 

The system S^j stands for the searching or wandering dynamics. We will consider S^ 
subject to the following conditions: 

Assumption 2 (Wandering dynamics) The system S^j is forward- complete: 

u^{t) eU^^ z{t) e Z, V t > to, he M+ 

and there exists an "output" function h : M., and two "bounding" functions 70 G K,oo,e, 

7 G /Coo,e such that the following integral inequality holds: 

S^: [ ii{uUr))dT<h{z{to))-h{z{t))< [ ^o{uUr))dT,\ft>to, toeR+ (8) 

J to J to 

In case system S^ is specified in terms of vector-fields 

z = f,(z,Mj, f,(-,-) (9) 

Assumption [2] can be viewed, for example, as postulating the existence of a function h : 
M_,_ of which the evolution in time is a mere integration of the input Uw{t). In general, 
for Uu, '■ Uw{t) > Q V t G M+, inequality ([8]) implies monotonicity of function h{z{t)) in t. 
Regarding the function 7o(-) in ([8]), we assume that for any M G M+ there exist functions 
7o,i : M+ M+ and 70,2 : ^+ such that 

7o(«-&) <7o,i(a) ■7o,2(&),Va,6G [0,M]. (10) 

^For a comprehensive characterization of the input-to-state stabihty and detailed mathematical arguments 
we refer to the paper by E.D. Sontag and Y. Wang [24] , 
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Figure 1: a. The class of interconnected systems Sa and 5^. System Sa, the "contracting system", 
has an attracting invariant set A in its state space, system does not necessarily have an attracting 
set. It represents the "wandering" dynamics. A typical example of such behavior is the dynamics 
of the flow in a neighborhood of a saddle point in three-dimensional space (diagram b). 



Requirement (fTOl) is a technical assumption which will be used in the formulation and proof 
of the main results of the paper. Yet, it is not too restrictive; it holds, for instance, for a 
wide class of locally Lipschitz functions 7o(-) : 7o(a ■ b) < Lq{M) ■ (a ■ 6), Lq{M) G M+. 
Another example for which the assumption holds is the class of polynomial functions 7o(-) : 
7o(a - h) = {a-by = a^-lf,p> 0. No further restrictions will be imposed a-priori on Sa, S^. 
Now consider the interconnection of (El), (IHl) with coupling Ua(t) = h{z(t)), and Us(t) = 
|_^. Equations for the combined system can be written as: 

^ </?(l|x(to)IU , t - to) + c||MzW)l|oo,M] 

'7i(||x(r)||_,)rfr <h{z{to)) - h{z{t)) < T 7o(||x(r) HJdr, ^^^^ 

to •'to 

A diagram illustrating the general structure of the entire system ffTTl) is given in figure [H 

Equations (|TT|) capture the relevant interplay between contracting, Sa, and wandering, 
Syj, dynamics inherent to a variety of searching strategies in the realm of optimization, ([3D, 
and interconnections (jl]) in general systems theory. In addition, this kind of interconnection 
describes the behavior of systems which undergo transcritical or saddle-node bifurcations. 
Consider for instance the following system: 

X2 = e + 7x^,7 > 

where the parameter e varies from negative to positive values. At e = stable and unstable 
equilibria collide leading to the cascade satisfying equations f|TT]) . An alternative bifurcation 
scenario could be represented by system: 

Xi = -Xi+X2 ^^^^ 
X2 = £ + 7X2,7 > 0, 

In this case, however, the dynamics of the variable X2 is independent of xi, and analysis of 
asymptotic behavior of (fT3ll reduces to the analysis of each equation separately. Thus systems 



6 



like fll3l) are easier to deal with than f[T^ . This constitutes an additional motivation for the 
present approach. 

When analyzing the asymptotic behavior of interconnection (fTT!) we will address the 
following set of questions: is there a set (a weak trapping set in the system state space) such 
that the trajectories which start in this set are bounded? It is natural to expect that the 
existence of such a set depends on the specific functions 'yo{-), 7i(-) in (ITT]) , on properties of 
■), and on values of c. In case such a set exists and could be defined, the next questions 
are therefore: where will the trajectories converge and how can these these domains be 
characterized? 

4 Main Results 

In this section we provide a formal statement of the main results of our present study. In 
Section l^?Tl we formulate conditions ensuring that there exists a point xq © zq such that the 
cu-limit set of xq © zq is bounded in the following sense: 

||t^x(xo © zo)||_4 < oo, |/l(t^z(xo © Zo))| < OO (14) 

These conditions and also a specification of the set of points x' © z' for which the a;-limit 
set satisfies property ( fT^ are provided in Theorem [H 

In order to verify whether an attracting set exists in uj{Q^/) that is a subset of uj{Q^/) we 
use an additional characterization of the contracting system Sa- In particular, we introduce 
the intuitively clear notion of the input-to state steady-state characteristic^^ of a system. It 
is possible to show that in case system Sa has a steady-state characteristic, then there exists 
an attracting set in uj{Q^) and this set is uniquely defined by the zeros of the steady-state 
characteristics of Sa- A diagram illustrating the steps of our analysis is provided in Fig. [21 
as well as the sequence of conditions leading to the emergence of the attracting set in ffTTl) . 

4.1 Emergence of the trapping region. Small-gain conditions 

Before we formulate the main results of this subsection let us first comment briefly on the 
machinery of our analysis. First of all we introduce three sequences 

S = {a,}Zo, ^ = {^^^=o, T = {n}Zo 

The first sequence, S, partitions the interval [0, h{zo)], h{zo) > into the union of shrinking 
subintervals Hf. 

[0, h{zo)] = UZoHi, Hi = [aM^o), cTi+i/i(zo)] (15) 
For the sake of transparency, let us define this property formally in the form of Condition [T] 

Condition 1 (Partition of zq) The sequence S is strictly monotone and converging 

{an}Z=o ■■ lim a„ = 0, ao = 1 (16) 

Sequences E and T will specify the desired rates G H of the contracting dynamics 
in terms of function /5(-,-) and time Ti > ti E T. Let us, therefore, impose the following 
constraint on the choice of S, T. 

^ A more precise definition of the steady-state cliaracteristics is given in Section 14.21 
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Figure 2: Emergence of a weak (Milnor) attracting set f^oo- Panel a depicts the target invariant 
set r^oo as a filled circle. First (Theorem [1]) , we investigate whether a domain C M" x exists 
such that ||x(t)||_^, h{z{t)) are bounded for all xq © zq € 1^7. In the text we refer to this set as a 
weak trapping region or simply a trapping region. The trapping region is shown as a grey domain in 
panel h. In principle, the system's states can eventually leave the domain 0^,. They must, however, 
satisfy equation (dH), ensuring boundedness of ||x(t)||_^, h{z{t)). As a result they will dwell within 
the region shown as a circle in panel b. Notice that neither this domain, nor the previous, need be 
neighborhoods of fioo- Second (Lemma's [U [2l Corollary [1]) , we provide conditions which lead to 
the emergence of a weak attracting set in the trapping region O^. This is illustrated in panel c. 



Condition 2 (Rate of contraction, Part 1) For the given sequences S, T and function 
I3{-, ■) G ICC in ^ the following inequality holds: 

/3(-,T,) <e./5(-,0), VT, >r, (17) 

Condition [2] states that for the given, yet arbitrary, factor C,i and time instant to, the amount 
of time Tj is needed for the state x in order to reach the domain: 

||x|U<e./3(||x(to)IU,0) 

In order to specify the desired convergence rates ^j, it will be necessary to define another 
measure in addition to f|T7|) . This is a measure of the propagation of initial conditions xq 
and input /i(zo) to the state x(t) of the contracting dynamics ([6]) when the system travels 
in h{z{t)) G [0, /i(zo)]. For this reason we introduce two systems of functions, $ and T: 

=^j^iop^j{^i_j-p{s,0)), J = l,...,i . . 

Ms) =(3is,0) ^'""^ 

vo{s) =/?(s,0) 

where the functions p^j, p^j G fC satisfy the following inequality 

(pj-i{a + b) < (pj^i o p0j(a) + (pj^i o p„j(6) (20) 

Notice that in case /3(-,0) G /Coo the functions p^,j{-), Pv,j{-) will always exist [12]. The 
properties of sequence S which ensure the desired propagation rate of the influence of initial 
condition xq and input H^zq) to the state x(t) are specified in Condition [31 

Condition 3 (Rate of contraction, Part 2) The sequences 
a-^ ■ 0„(||xo||_4), ■ (^Vi{c\h{zo)\an^i)^ , 



n = . . . , 00 
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are bounded from above, e.g. there exist functions Bi{\\:>cq\\) , i?2(|^(zo)|, c) such that 



a. 



^1 



n 



|xo|U)<i?i(||xo|U) (21) 



^n' ■ 5Zt;.(c|/i(zo)|a„_,) < B2{\h{zo)\,c) (22) 



,i=0 



for all n = 0,1, oo 



For a large class of functions (3{s, 0), for instance those that are Lipschitz in s, these condi- 
tions reduce to more transparent ones which can always be satisfied by an appropriate choice 
of sequences S and S. This case is considered in detail as a corollary of our main results in 
section I4.3[ 

The main differences between the standard and the presently proposed approaches for 
the analysis of asymptotic behavior of dynamical systems are illustrated with figure [31 In 
order to prove the emergence of the trapping region we consider the following collection of 
volumes induced by the sequence Si and the corresponding partition (fT5|) of the interval 
[0,/i(zo)]: 

ni = {^e x,ze z\ h{z{t)) e Hi} (23) 

For the given initial conditions xq G A", zq G 2 two alternative possibilities exist. First, the 
trajectory x(t,xo) © z(t, zq) stays in some Q' C Qq for all t > t', t' > to- Hence for t ^ oo 
the state will converge into 

fi„ = {x G A", z G Z| ||x||_^ < c ■ h{zo), z : h{z) G [0, h{zo)]} (24) 

Second, the trajectory x(t, xq) © z{t, zq) subsequently enters the volumes VLj, and tj are the 
time instances when it hits the hyper-surfaces h{z{t)) = h{zo)crj. Then the state of the 
coupled system stays in Qq only if the sequence {ti}^o diverges. Theorem [1] provides the 
conditions specifying the latter case in terms of properties of sequences S, S, T and function 
7o(-) in m- 

Theorem 1 (Non-uniform Small-gain Theorem) Let systems Sa, be given and sat- 
isfy AssumptionsUll^ Consider their interconnection DJ]) and suppose there exist sequences 
S, S, and T satisfying Conditions [JW^ In addition, suppose that the following conditions 
hold: 

1 ) There exists a positive number Aq > such that 

l (^i- cr.+i) > V z = 0, 1, . . . , oo (25) 
Tj 7o,i(cri) 

2) The set VL^ of all points xq, zq satisfying the inequality 

7o,2(fii(||xo|U) + 52(|/i(zo)|, c) + c\h{zo)\) < /i(zo)Ao (26) 

is not empty. 

3) Partial sums of elements from T diverge: 

oo 



5^ri = cx) (27) 



i=0 
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Standard 


Proposed 


1) Domain of attraction is a neighbor- 
hood 


1) Domain of attraction is a set of 
positive measure (not necessarily a 
neighborhood) 


2) Imphes Lyapunov stabihty 


2) Allows to analyze convergence in 
Lyapunov-unstable systems 


x(to)ez(to) =Ao 

"^KS- C^N^ x(fi)©z(ti) =Ai 

/ ^T^AA K(f2)®z(t2) =A2 

"yly^^ =Ai 


no 

2^-4:S>?^^^ (t2)® Z(t2) € 2 
"^^X X(ti)®z(ti) € n; 


Given: a sequence of diverging time in- 
stances ti 


Given: a sequence of sets f2j whose dis- 
tance Aj to A is converging to zero 


Prove: convergence of norms x(tj) © 
z(ti) = Ai to zero 


Prove: divergence of {ti}, where ti : 

x(ti) © z{ti) E ni 



Figure 3: Key differences between the conventional concept of convergence (left panel) and the 
concept of weak, non-uniform, convergence (right panel). In the uniform case, trajectories which 
start in a neighborhood of A remain in a neighborhood of A (solid and dashed lines). In the 
non-uniform case, only a fraction of the initial conditions in a neighborhood of A will produce 
trajectories which remain in a neighborhood of A (solid black line). In the most general case a 
necessary condition for this to happen is that the sequence {ti} diverges. In our current problem 
statement divergence of {ti} imphes boundedness of ||x(t)||_4. To show state boundedness and 
convergence of x(t) to A an additional information on the system dynamics will be required. 

Then for all xq, zq G Q-y the state x(t,Zo) © z(t, zq) of system 01]) converges into the set 
specified by [24^ 

ila = {x E X, z E Z\ ||x||^ < c ■ /i(zo), z : h{z) E [0, /i(zo)]} 

The proof of the theorem is provided in Appendix 1. 

The major difference between the conditions of Theorem [1] and those of conventional 
small-gain theorems [33], [12] is that the latter involve only input-output or input-state map- 
pings. Formulating conditions for state boundedness of the interconnection in terms of 
input-output or input-state mappings is possible in the traditional case because the inter- 
connected systems are assumed to be input-to-state stable. Hence their internal dynamics 
can be neglected. In our case, however, the dynamics of is generally unstable in the 
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Lyapunov sense. Hence, in order to ensure boundedness of x(t, xq) and h{z{t,zo)), the 
rate/degree of stability of Sa should be taken into account. Roughly speaking, system Sa 
should ensure a sufficiently high degree of contraction in xq while the input-output response 
of iS^ should be sufficiently small. The rate of contraction in xq of Sa, according to ([6]), is 
specified in terms of the function Properties of this function that are relevant for 

convergence are explicitly accounted for in Condition [3] and (127|) . The domain of admissible 
initial conditions and actually the small-gain condition (input-state-output properties of 
and Sa) are defined by fl25l) . fl26l) respectively. Notice also that is not necessarily a neigh- 
borhood of fla, thus the convergence ensured by Theorem [1] is allowed to be non-uniform in 

Xo, Zq. 

4.2 Characterization of the attracting set 

Even for interconnections of Lyapunov-stable systems, small-gain conditions usually are 
effective merely for establishing boundedness of states or outputs. Yet, even in the setting of 
Theorem [T] it is still possible to derive estimates (such as, for instance 0241) ) of the domains 
to which the state will converge. These estimates, however, are often too conservative. If 
a more precise characterization of these domains is required, additional information on the 
dynamics of systems Sa and S^ will be needed. The question, therefore, is how detailed 
this information should be? It appears that some additional knowledge of the steady-state 
characteristics of system Sa is sufficient to improve the estimates substantially. 
Let us formally introduce the notion of steady-state characteristic as follows: 

Definition 3 We say that system ^ has steady-state characteristic x : M ^ 5{M4_} with 
respect to the norm ||x|L if and only if for each constant Ua the following holds: 



The key property captured by Definition [3] is that there exists a limit of ||x(t)||_^ as t — cx), 
provided that the limit for Ua(t) , t ^ oo is defined and constant. Notice that the mapping x is 
set- valued. This means that for each Ua there is a set x(^a) C M+ such that ||x(t) ||_^ converges 
to an element of xi'^^a) as t — >■ oo. Therefore, our definition allows a fairly large amount of 
uncertainty for Sa- It will be of essential importance, however, that such characterization 
exists for the system Sa- 

Clearly, not every system obeys a steady-state characteristic x(') of Definition [31 There 
are relatively simple systems of which the state does not converge even in the "norm" sense 
for constant converging inputs (condition (128!) ). In mechanics, physics, and biology such 
systems encompass the large class of nonlinear oscillators which can be excited by constant 
inputs. In order to take such systems into consideration, we introduce a weaker notion, that 
of steady-state characteristic on average: 

Definition 4 We say that system ^ has steady-state characteristic on average xt '■ ^ 
5{M+} with respect to the norm ||x||_^ if and only if for each constant Ua and some T > 
the following holds: 



'i Uait) eUa'. \miUa{t)=Ua lim ||x(t) ||_^ G %(«„) 




(28) 



V Ua(t) G Ua : lim Ua(t) = Ua ^ hm 




^{r)\\_^dT e xAua) (29) 
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Steady-state characterizations of system Sa allow to further specify the asymptotic behavior 
of interconnection (fTTI) . These results are summarized in Lemmas [1] and [2] below. 

Lemma 1 Let system / flT]) be given and h{z{t,Zo)) be bounded for some Xo,Zo. Let, fur- 
thermore, system ^ have steady-state characteristic '■ ^ iS{R+}. Then the following 
limiting relations hol^ 

lim ||x(t,Xo)|U = 0, lim h{z{t,Zo)) G x'\0) (30) 

As follows from Lemma [H in case the steady-state characteristic of Sa is defined, the asymp- 
totic behavior of interconnection (fTTI) is characterized by the zeroes of the steady-state 
mapping x{')- Fo^' the steady-state characteristics on average a slightly modified conclusion 
can be derived. 

Lemma 2 Let system 07]) be given, /i(z(t,zo)) be bounded for some xo,zo, /i(z(t,zo)) G 
[0,h{zo)], and system ^ have steady-state characteristic Xr(-) : R '5{M+} on average. 
Furthermore, let there exist a positive constant j such that the function 'yi{-) in ^ satisfies 
the following constraint: 

li{s) > 7 ■ s, Vs e [0, s], s e M+ : s> c- h{zo), (31) 

In addition, suppose that Xt{') has no zeros in the positive domain, i.e. ^ Xr(wa) for all 
Ua > 0. Then 

lim ||x(t, xo) |L = 0, lim /i(z(t, zq)) = (32) 

t— >oo t— >oo 

An immediate outcome of Lemmas [1] and [2] is that in case the conditions of Theorem 
[1] are satisfied and system ([6]) has steady-state characteristics x(") or Xt(-) the domain of 
convergence fla becomes 

na = {^eX, zeZ\ ||x||^ = 0, z : h{z) G [0, h{zo)]} (33) 

It is possible, however, to improve estimate fl33|) further under additional hypotheses on 
system Sa and S^ dynamics. This result is formulated in the corollary below. 

Corollary 1 Let system HI]) be given and satisfy the assumptions of Theorem [I]. Let, in 
addition, 

CI ) the flow x(t, Xo) © z(t, zq) be generated by a system of autonomous differential equa- 
tions with locally Lipschitz right-hand side; 

C2) subsystem S^ be practically integral-input-to- state stable: 

<C,+ -f,{uUr))dT (34) 
Jo 

and let function h{-) & in ^ 

C3) system Sa have steady-state characteristic x(-)- 
Then for all xq, zq G VL^ the state of the interconnection converges to the set 

VLa = {^e X,ze Z\ ||x||_4 = 0, h{z) G X"^(0)} (35) 



^The symbol x -^(0) in equation ([30|l denotes the set: x ^(0) = Uo^eR^. "a • x("a) 3 0- 

12 



Figure 4: Control of the attracting set by means of the system's steady-state characteristics 

As follows from Corollary [1] zeros of the steady state characteristic of system Sa actually 
" controls" the domains to which the state of interconnection ( iTTl) might potentially converge. 
This is illustrated in Fig. HI Notice also that in case condition C3 in Corollary [1] is replaced 
with the alternative: 

C3') system Sa has a steady-state characteristic on average Xt{-), 
then it is possible to show that the state converges to 

Oa = {x G A", z G Z| ||x||_^ = 0, h{z) = 0} (36) 

The proof follows straightforwardly from the proof of Corollary [1] and is therefore omitted. 

4.3 Systems with contracting dynamics separable in space-time 

In the previous sections we have presented convergence tests and estimates of the trapping 
region, and also characterized the attracting sets of interconnection (fTTl) under assumptions 
of uniform asymptotic stability of Sa and input-output properties ([8]), of system S^. 
The conditions are given for rather general functions •) G JCC in and 'yo{-), 7i(-) in 
dH]). It appears, however, that these conditions can be substantially simplified if additional 
properties of /?(■, ■) and 7o(-) are available. This information is, in particular, the separability 
of function /?(■, ■) or, equivalently, the possibility of factorization: 

/3(||x|U,t)</3.(||x|U)-A(t), (37) 

where (3x{-) G /C and /3t(-) G C° is strictly decreasing with 

lim Pt{t) = (38) 

In principle, as shown in [8], factorization ( |371) is achievable for a large class of uniformly 
asymptotically stable systems under an appropriate coordinate transformation. An immedi- 
ate consequence of factorization fl37j) is that the elements of sequence S in Condition [2] are 
independent of ||x(tj)||^. As a result, verification of Conditions [2l [3] becomes easier. The 
most interesting case, however, occurs when the function I3x{-) in the factorization (l37l) is 
Lipschitz. For this class of functions the conditions of Theorem [1] reduce to a single and 
easily verifiable inequality. Let us consider this case in detail. 

^If /?*(•) is not strictly monotone, it can always be majorized by a strictly decreasing function 
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Without loss of generality, we assume that the state x(t) of system Sa satisfies the 
following equation 

||x(t)lU < l|x(to)lU ■ /3tit -to) + c- l|/i(z(r, zo))l|oo,[to,t], (39) 

where /5t(0) is greater or equal to one. Given that Ptit) is strictly decreasing, the mapping 
j3t : [0,00] I— > [0,/3t(0)] is injective. Moreover Pt(t) is continuous, then it is surjective and, 
therefore, bijective. In the other words there is a (continuous) mapping : [0, A(0)] 1— R+: 

f3-'of3,{t)=t, Vt>0 (40) 

Conditions for emergence of the trapping region for interconnection flTTl) with dynamics of 
system Sa governed by equation (15^ are summarized below: 

Corollary 2 Let the interconnection be given, system Sa satisfy and function 'Jq{-) 
in 13) be Lipschitz: 

\lois)\<D,,o-\s\ (41) 

and domain 

o . n < (B-'(^)y'^ ^ (42) 

'''-V' k ^^(o)||xo|U + A(0)-c-|Mzo)|(1 + ^)+c|Mzo)| ^ ^ 

is not empty for some d < 1, n > 1. Then for all initial conditions xq zq G VL^ the state 
x(t,xo) ©z(t, Zq) of interconnection (Tl\) converges into the set Via specified by (24\ )- If, in 
addition, conditions Cl)-C3) of Corollary U\ hold then the domain of convergence is given by 

m 



A practically important consequence of this corollary concerns systems Sa which are 
exponentially stable: 

||x(t)||_4 < ||x(to)IUl^/3exp(-At) + c- ||/i(z(t,zo))||oo,[to,t],A > 0, > 1 (43) 

In this case the domain (j^2|) of initial conditions ensuring convergence into Qa is defined as 



D^^o < max -A ( In - ^ ^ ^' 



K>i, de(o,i) \ K, /}^||xo||_4 + L'/3-c- |/i(zo)| (1 + +c|/i(zo) 



5 Discussion 



In this section we discuss some practically relevant outcomes of the results of Theorem [T] 
and Corollaries [H [2] and their potential applications to problems of analysis of asymptotic 
behavior in nonlinear dynamic systems. 

First, in Subsection 15. II we specify conditions for existence of a trapping region of nonzero 
volume in © in terms of the parameters of system flTTl) without invoking dependence 
on x(to), z(to) as was done in Theorem [H The resulting criterion has a form similar to the 
standard small-gain conditions [33]. The differences and similarities between this new result 
and standard small-gain theorems are illustrated with an example. 

Second, in Subsection 15.21 we demonstrate how the results of our present contribution 
can be applied to address the problem of output nonlinear identification for systems which 
cannot be transformed into a canonic observer form or /and with nonlinear parametrization. 
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5.1 Relation to conventional small- gain theorems 



Conditions specifying state boundedness formulated in Theorem [T] and Corollaries [H [2] de- 
pend explicitly on initial conditions x(to), z(to)- Such dependence is inevitable when the 
convergence is allowed to be non-uniform. But if mere existence of a trapping region is asked 
for, dependence on initial conditions may be removed from the statements of the results. The 
next corollary presents such modified conditions. 

Corollary 3 Consider interconnection 01]) where the system Sa satisfies inequality and 
the function 7o(-) obeys Then there exists a set of initial conditions corresponding 

to the trajectories converging to Qa if the following condition is satisfied 



D 



7,0 



c-g<i, 



(44) 



where 



d 



for some d E (0, 1), k G (1, oo). In particular, Vt^ contains the following domain 



|x(t, 



o;iu 



< 



A(o) 



D 



7,0 



-1 



d 



h{z{to)). 



In case the function h{z) in fTl\) is continuous, the volume of the set is nonzero in 



Notice that in case the dynamics of the contracting subsystem Sa is exponentially stable, 
i.e. it satisfies inequality the term Q in condition (jUj) reduces to 

For Dp = 1 the minimal value of Q in fHSj) can be estimated as 

^* 1 . ft^\ k f K \ 15.6886 16 

g* = -- min In(-)- 2 + -\ ^ ^ < — , 46 

A dG(o,i), KG(i,oo) \dJk-l\ 1-dJ X A 



which leads to an even more simple formulation of fl45l) : 

^ c 1 
D^,o ■ -r < 



A - 16 



Corollary [3] provides an explicit and easy-to-check condition for existence of a trapping 
region in the state space of a class of Lyapunov unstable systems. In addition, it allows to 
specify explicitly points x(to), z(to) which belong to the emergent trapping region. Notice 
also that the existence condition, inequality (l44l) . has the flavor of conventional small-gain 
constraints. Yet, it is substantially different from these classical results. This is because the 
input-output gain for the wandering subsystem, S^, may not be finite or need not even be 
defined. 
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To elucidate these differences as well as the similarities between conditions of conventional 
small-gain theorems and those formulated in Corollary [3] we provide an example. Consider 
the following systems 

Xi = — AiXi + C1X2 
X2 = -A2X2 - C2\Xi\ 



(47a) 



xi = -XiXi + C1X2 
X2 = -C2|a;i| 



(47b) 



System fl47ap can be viewed as an interconnection of two input-to-state stable systems, Xi 
and X2, with input-output Loo-gains Ci/Ai and C2/A2 respectively. Therefore, in order to 
prove state boundedness of fl47al) we can, in principle, invoke the conventional small-gain 
theorem. The small-gain condition in this case is as follows: 



Ai A2 



(48a) 



The theorem, however, does not apply to system (14 7b 11 because the input-output gain of its 
second subsystem, X2, is infinite. Yet, by invoking Corollary [3] it is still possible to show 
existence of a weak attracting set in the state space of system fl47bl) and specify its basin of 
attraction. As follows from Corollary [HI condition 



C2 J_ 

Ai ' Ai ^ 16 

ensures existence of the trapping region, and the trapping region itself is given by 



(48b) 



\xi{to)\ < 



C2 



-Ai In 



-1 A; - 1 



Ai 



K 



1-d 



X2(to) 



5.2 Output nonlinear identification problem 

In the literature on adaptive control, observation, and identification a few classes of systems 
are referred to as canonic forms because they guarantee existence of a solution to the problem 
and because a large variety of physical models can be transformed into this class. Among 
these, perhaps the most widely known is the adaptive observer canonical form [3]. Necessary 
and sufficient conditions for transformation of the original system into this canonical form can 
be found, for example, in p6]. These conditions, however, include restrictive requirements 
of linearization of uncertainty-independent dynamics by output injection, and they also 
require linear parametrization of the uncertainty. Alternative approaches ^ heavily rely on 
knowledge of the proper Lyapunov function for the uncertainty-independent part and still 
assume linear parametrization. 

We now demonstrate how these restrictions can be lifted by application of our result 
to the problem of state and parameter observation. Let us consider systems which can be 
transformed by means of static or dynamic feedbacl|§ into the following form: 

i = fo(x, t) + f (|(t), 0) - mt), 0) + 6(t), (49) 
^Notice that conventional observers in control theory could be viewed as dynamic feedbacks. 
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where 

GL^[to,oo], ||6(r)|U,[t„,i] < A, 

is an external perturbation with known Ag, and x G M". The function £ : M+ — > 
is a function of time, which possibly includes available measurements of the state, and 
d , & fig <Z M.'^ are the unknown and estimated parameters of function the f (■), respectively, 
and the set Qq is bounded. We assume that the function f (^(t), 6) is locally bounded in 6 
uniformly in ^: 

\\mt),o)-fm,o)\\<Df\\e-e\\ + Af 

and the values of G M+, Aj are available. The function fo(-) in pojl is assumed to satisfy 
the following condition. 

Assumption 3 The system 

i = fo(x,t) + u(t) (50) 
is forward- complete. Furthermore, for all u(t) such that 

u ~l" II 'J-o(''~) II oo,[to,t] ) 

A„ G M+ 

there exists a bounded set A, c > and a function A : R_|_ satisfying the following 

inequality 

||x(t)|U^^^^^ </5(t-to) ||x(to)IU^,^^, +c||uo(r)|U,[to,t] 
where /?(•) : IR+ ^ ]R_|_, limt^oo/3(t) = a strictly decreasing function 
Consider the following auxiliary system 

A = 5(A), A(to) = Ao G l^A C (51) 

where Qx C M" is bounded and ^(A) is locally Lipschitz. Furthermore, suppose that the 
following assumption holds for system fl^ . 

Assumption 4 System 137]) is Poisson stable in VL\ that is 

V A' G ^A, t' G M+ ^ 3t" > t : II A(t", A') - A'll < e, 

where e zs an arbitrary small positive constant. Moreover, the trajectory A(t, Aq) is dense in 
fix: 

VA' eftx, e G M>o ^ 3 t G M+ : ||A' - A(t, Ao)|| < e 
Now we are ready to formulate the following statement 

Corollary 4 Consider system and suppose that the following conditions hold 
C4) the vector-field fo(x, t) in ( [TP] ) satisfies Assumptions^ 
C5) there exists a (known) system [5T\) satisfying Assumption^ 
C6) there exists a locally Lipschitz 77 : R'^ ^ M°'.- 

||r7(A')-r7(A")|| < AJ|A'-A"|| 

such that the set r){fl\) is dense in VLq; 

CI) system ( [7^ has steady-state characteristic with respect to the norm 

||-|L , M = 2A. + As + (5 

II II^A(M) ' ' ^ 
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and input 6, where 5 is some positive (arbitrary small) constant. 
Consider the following interconnection of [J^ lt If51\) : 

± = fo{^,t)+mt),o)-mt),o)+s{t) 

= rj{X) (52) 
where 7 > satisfies the following inequality 



7 



< 



K 



Dx im (1 + T^) + 1) (53) 



D, = c-Df-D,.max\\S{X)\\ 

for some d G (0, 1), k G (1, 00). Then, for A(to) = Aq, some 0' G fie and a//x(to) = xq G M"' 
the following holds 

}^ ll^(^)IU.(M, = 0' = 0'ene (54) 

Notice that, as has been pointed out in the previous section, in case the dynamics of (150|) is 
exponentially stable with rate of convergence equal to p and (3{0) = D13, condition (!53|) will 
have the following form 

d\'^K-l 1 



7 < — p In — 



K / K 



According to Corollary HJ for the rather general class of systems ( H9|) it is possible to 
design an estimator 6{t) which guarantees that not only the "error" vector x(t) reaches a 
neighborhood of the origin, but also that the estimates 6{t) converge to some 0' in Qg. Both 
these facts, together with additional nonlinear persistent excitation conditions [6]. [27] 

3r>0,pG/C: VT = [t,t + T], tGR+^3rGT: |f (^(r), 6>) - f (^(r), 6>') | > M||6> - 6/'||), 

in principle allow us to estimate the domain of convergence for 6{t). 

Concluding this section we mention that statements of Theorem [T] and Corollaries [THU 
constitute additional theoretical tools for the analysis of asymptotic behavior of systems in 
cascaded form. In particular they are complementary to the results of [I] where asymptotic 
stability of the following type of systems 

x = f(x), 

z = q(x, z), f : ^ M", q : M" x R"^ M*" 

was considered under assumption that the x-subsystem is globally asymptotically stable and 
the z-subsystem is integral input-to-state stable. In contrast to this, our results apply to 
establishing asymptotic convergence for systems with the following structure 

X = f(x,z), 

z = q(x,z), f : R" X R"^ ^R'^ 

where the x-subsystem is input-to-state stable, and the z-subsystem could be practically 
integral input-to-state stable (see Corollary [1]) , although in general no stability assumptions 
are imposed on it. 
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6 Examples 



In this section we provide two examples of parameter identification in nonlinearly parame- 
terized systems that cannot be transformed into the canonical adaptive observer form. 

The first example is merely an academical illustration of Corollary HJ where only one 
parameter is unknown and the system itself is a first-order differential equation. The second 
example illustrates a possible application of our results to the problem of identifying the 
dynamics in living cells. 

Example 1. Consider the following system 

X = —kx + sin(x6' + 9) + u, k > 0, 9 E [—a, a] (55) 

where 9 is an unknown parameter and u is the control input. Without loss of generality we 
let a = 1, = 1. The problem is to estimate the parameter 9 from measurements of x and 
steer the system to the origin. Clearly, the choice u = — sin(x^ + 9) transforms (I55p into 

X = —kx + sin(x6' + 9) — sin(x^ + 9) (56) 

which satisfies Assumption [31 Moreover, the system 

Ai = Ai 

A2 = -A2, Xlih) + Xlih) = I 
with mapping 77 = (1, 0)^A satisfies Assumption H] and therefore 

Ai = 7|a;|Ai 

(57) 

A2 = -7|x|A2, Xlito) + Xlito) = 1 

would be a candidate for the control and parameter estimation algorithm. According to 
Corollary m the goal will be reached if the parameter 7 in (!57j) obeys the following constraint 

7<-p(ln-) - — - ^ p = k=l, Di3=l, Dx = l 

for some d G (0, 1), k G (1, 00). Hence, choosing, for example, d = 0.5, k = 2 we obtain that 
choice 

0.5\"M 1 



0<7<-ln — = 0.0601 

' V 2 / 2 6 

suffices to ensure that 

lim x{t) = 0, hm 9{t) = 9 

>oo t— >oo 

We simulated system (15^ . (IS71) with 9 = 0.3, 7 = 0.05 and initial conditions a;(to) 
randomly distributed in the interval [—1,1]. Results of the simulation are illustrated with 
Figure [5], where the phase plots of system (I56I1 . (1571) as well as the trajectories of 9(t) are 
given. 

Example 2. Consider the problem of modelling electrical activity in biological cells from 
the input-output data in current clamp experiments. The simplest mathematical model, 
which captures a fairly large variety of phenomena like periodic bursting in response to 
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Figure 5: Trajectories of system fl56l) . fl571) (left panel) and the family of estimates 9{t) of 
parameter 6 as functions of time t (right panel) 



constant stimulation is the classical Hindmarsh and Rose model neuron without adaptation 
currents fTOj: 

xi = —axf + hx\ + X2 + au 

x, = c-i5x,-dx\ ^''^ 

where variable xi is the membrane potential, X2 stands for the ionic currents in the cell, u 
is the input current, and a, b, c, d, a, P & M. are parameters. While the parameters of the 
first equation can, in principle, be identified experimentally by blocking the ionic channels 
in the cells and measuring the membrane conductance, identification of parameters f3, d is a 
difficult problem, as information about ionic currents X2 is rarely available. 

Conventional techniques [3] cannot be apphed directly to this problem as the model ( j58l) 
is not in canonical adaptive observer form. Let us illustrate how our results can be used to 
derive the unknown parameters of (l58l) such that the reconstructed model fits the observed 
data. Assume, first, that parameters a, b, c, a in the first equation of fl58|) are known, whereas 
parameters (3, d in the second equation are unknown. This corresponds to the realistic case 
where the time constant of current X2 and coupling between xi and X2 are uncertain. In our 
example we assumed that 

p enp = [0.3, 0.7], e = [2, 3], a = 1, 6 = 3, a = 0.7, c = 0.5 

As a candidate for the observer we select the following system 

X = p{xi — x) — axf + bx\ + au + f{(3, d,t), p G ]R>o (59) 

where /3, d are parameters to be adjusted and the function f0,d,t) is specified as 

f0,d,t)= [ e-^'^'-^\dxl{T) + c)dT 
Jo 

Then the dynamics of x{t) = x{t) — x{t) satisfies the following differential equation 

S: = -px + f{(3,d,t)-f0,d,t) 
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The function f{P,d,t) satisfies the following inequality 

\fiP, d, t) - f{(3, 1 1) I < |/(/?, t) - f0, d,t)\ + \f0, d, t) - f0, 1 1) I 

<Df,p\l3-P\ + Dj,d\d-d\+e{t), 

where e{t) is an exponentially decaying term, and 

Df^p= max ji(rf||a;i(r)||oo,[to.oo] + c)l , = max ji||xi(r)||oo,[to.oo]| (60) 

Furthermore, Assumption [3] is satisfied for system 

X = —px + v{t), (61) 

with 

A(A„) = ^. 

P 

In particular, for all v{t) : ||t'(r)||oo,[to,t] < A„ + ||t^o(T)||oo,[to,t] the following inequality holds: 

lk(t)l|A(A.) < e-''(*-*")||x(to)||A{A„) + Vo(r)||oo,[*o.t]- (62) 
To see this consider the general solution of (16T|) : 

x{t) = e-^(*-*»)x(to) + e"^* / eP^v{T)dT 



J to 

and derive an estimate of |a;(t)|. This estimate has the following form: 

\x{t)\ < e-^(*-*«)|x(to)| + - (1 - e-^(*-*«)) ||t;(r)|U,[io,*] 

p 

< e-'^'-''^ (|x(to)| - ^A^^ + i (||t;o(r)||oo,[to,t] + A.) 

< e-^(*-*«)||a;(to)||A(A.) + ^ (||t^o(r) ||oo,[*o,t] + A„) 

Hence 

- ^A, < e"^(*-*«)||x(to)||A(A„) + Vo(r)||oo,[to,t], 

which automatically implies fl62|) . 

Let us define subsystem f lSTl) . Consider the following system of differential equations 

Ai = A2 
A2 = — i-<^?Ai 

• _ (63) 
A3 — A4 

2\ \ _ n n 1 r\\T 



A4 = -0^2A3, Ao = (l,0,l,0) 
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where fix is the w-hmit set of the point Aq, and Ui, uj2 E M. System (1551) . therefore, satisfies 
Assumption m Given that domains fi/?, fid are known, select 

^,:R"-.IR^ >) = (r;i(A), ifelA)) 
. ^ ^^^^^ ^ 1 J^2a^ ^ ^ ^ 3_ . ^ ^^^^^^ _ 1 ^2a^ ^^y^ (64) 

Choosing 

— = TT 

we ensure that rjiflx) is dense in flp x Vl^- Given that /3, d are bounded and /3 > 0.3, Dfp 
and D/^d in dSD]) are also bounded because for the given range of parameters signal Xiit) is 
always bounded. Hence, according to Corollary HJ interconnection of fl59|) . (I64l) and 

Ai = 7||x(t)||A(5) ■ A2 

A2 = -7PWIIa{5) ■ t^?Ai 
A3 = 7||5(^)I|a(5) ■ A4 

A4 = -7p(t)||A(5) -cu^As, Ao = (1,0,1, of 
with arbitrary small 5 > and properly chosen 7 > ensures that 

lim \\x{t)\\Ms) = 0, lim (3{t) = P' e lim d{t) = d' e il^ 

t— >oo >oo t^oo 

This in turn implies a successful fit of the model to the observations. 

We simulated the system with p = 10 and 7 = 3- 10""^ for /? = 0.5, d = 2.5. The 
results of the simulations are provided in figure [61 It can be seen from this figure that the 
reconstruction is successful and the parameters converge into a small neighborhood of the 
actual values. 

7 Conclusion 

We proposed tools for the analysis of asymptotic behavior of a class of dynamical systems. In 
particular, we consider an interconnection of an input-to-state stable system with an unstable 
or integrally input-to-state dynamics. Our results allow to address a variety of problems in 
which convergence may not be unform with respect to initial conditions. It is necessary 
to notice that the proposed method does not require complete knowledge of the dynamical 
systems in question. Only qualitative information like, for instance, characterization of 
input-to-state stability of is necessary for application of our results. We demonstrated how 
our analysis can be used in the problems of synthesis and design - in particular to problems 
of nonlinear regulation and parameter identification of nonlinear parameterized systems. 
The examples show the relevance of our approach in those domains where application of the 
standard techniques is either not possible or too complicated. 
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Figure 6: Left panel - trajectories X2{t) of system (l58l) plotted for the nominal values 

of parameters P = 0.5, d = 2.5 (model), and for the values P = (3(to + T), d = d(to + T), 
where T is the total simulation time (reconstruction). Input u{t) is a rectangular impulse 
with amplitude 0.7 starting at t = 100 and ending at t = 300. Right panel - searching 
dynamics in the bounded parameter space (a segment of the trajectory (3(t),d(t) towards 
the end of the simulation). 



9 Appendix 

Proof of Theorem Ui Let the conditions of the theorem be satisfied for given to G M+: 
x(to) = xq, z(to) = zq. Notice that in this case /i(zo) > 0, otherwise requirement (126!) will 
be violated. Consider the sequence ( !23ll of volumes fli induced by S: 

O- = {x e A", zE Z\ h{z{t)) E Hi} 

To prove the theorem we show that < h{z{t)) < h{zQ) for all t > t^. For the given partition 
(l23l) we consider two alternatives. 

First, in the degenerative case, the state x(t) ©z(t) enters some Qj, j >0 and stays there 
for all t > to which automatically guarantees that < \h{z)\ < /i(zo). Then, according to 
(j6]) the trajectory x(t) satisfies the following inequality: 

||x(t)||^ < /3(||xo||_4 ,t - to) + c||/i(z(t))|U,[to,i] < /5(l|xolU ,t - to) + c\h{zo)\ (65) 

Taking into account that /?(■, ■) E ICC we can conclude that fl65|) implies that 

lim sup ||x(t)||_^ = c|/i(zo)| (66) 

>oo 

Therefore the statements of the theorem hold. 

Let us consider the second alternative, where the state x(t) © z{t) does not belong to flj 
for all t > to- Given that h{z{t)) is monotone and non-increasing in t, this implies that there 
exists an ordered sequence of time instants tf 

to > h > t2 - ■ -tj > tj+i ■ ■ ■ (67) 

such that 

h{ziti)) = aM^o) (68) 
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Hence in order to prove the theorem we must show that the sequence {tj}^o does not 
converge. In other words, the boundary aooh{zo) = will not be reached in finite time. 
In order to do this let us estimate the upper bounds for the following differences 

Taking into account inequality (IHl) and the fact that 7o(-) G /Ce we can derive that 

h{z{t,)) - h{z{U^,)) < T, max 7o(||x(r)|U) < T,7o(||x(r) (69) 

According to the definition of ti in fl68l) and noticing that the sequence S is strictly decreasing 
we have 

h{z{ti)) - h{z{ti+i)) = (o-j - o-,;+i)/i(zo) > 

Hence /i(zo) > implies that 7o(||x(r)||^^ ^.^^j) > and, therefore, (JSHD results in the 
following estimate of Tj 

y y h{z{U)) - h{z{ti+i)) ^ h{zo){(Xi - aj+i) 

Taking into account that h{z{t)) is non- increasing over and using ([6]) we can bound 

the norm ||x(r)||_4^ [,^_,^^^] as follows 



X r 



< /3(||x(t,)|U , 0) + c||/i(z(r))|U,^,,^,] < /3(||x(t.)|U , 0) + c ■ a,/i(zo) (71) 



Hence, combining (170]) and (17T]) we obtain that 



7o(a.(ari/5(||x(t,)|U,0) + c-/i(zo))) 
Then, using property (fTOl) of function 70 we can derive that 



y ^ /i(zo)(ff^ -g^+i) 1 

70,1(0^0 7o,2(crrV(i|x(t.)iU,0) + c-Mzo))) ^ ' 



Taking into account condition (1271) of the theorem, the theorem will be proven if we assure 
that 

Ti > n (73) 

for all i = 0, 1, 2, . . . , 00. We prove this claim by induction with respect to the index i = 
0, 1, ... , 00. We start with i = 0, and then show that for alH > the following implication 
holds 

Ti>Ti^ Ti+, > r,+i (74) 

Let us prove that ( 1731) holds for i = 0. To this purpose consider the term ((jj — ai+i)/7o,i(cri). 
As follows immediately from the conditions of the theorem, equation (J25ll . we have that 



7o,i(cri) 
In particular 



""'^^ > r,Ao V z > (75) 



7o,i(^o) 
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Therefore, inequality (172]) reduces to 

" ^'^%oA^o'PiMio)\\lo) + c-h{zo)) ^^^^ 

Moreover, taking into account Condition [3] and flTSl) . f[TI?l) we can derive the following esti- 
mate: 

ao-^/3(||x(to)IU,0) < ao-Vo(||x(to)U + ^o"%(c- |Mzo)|ao) < 5i(||xo|^ 

According to the theorem conditions xq and zq satisfy inequality (!26|) . This in turn implies 
that 

7o,2K'/5(l|x(to) lU , 0) + c ■ /i(zo)) < 7o,2(5i(||xo|U) + 52(|/i(zo)|, c) + c ■ /i(zo)) < Ao ■ /i(zo) 

(77) 

Combining ( 1761) and (JTTj) we obtain the desired inequality 

^ > A M^o) ^ Ao/i(zo) 

°- ° °7o,2(ao-^/3(||x(to)IU,0) + c-Mzo)) - °AoMzo) ° 

Thus the basis of induction is proven. 

Let us assume that ( 1731) holds for all i = 0, . . . ,n, n > 0. We shall prove now that 
implication (171|) holds for i = n + 1. Consider the term /?(||x(t„+i)||^ , 0): 

/?(||x(WOIU,0)</3(/5(||x(tOIU,T„)+cl|Mz(r))|Ujw„^^^ 
< /?(/3(||x(t„)IU , T„) + c ■ or„ ■ h{zo), 0) 

Taking into account Condition [2] (specifically, inequality (1171) ) and (I18p - (I2U]) we can derive 
that 



x(t„+i)||^,0) </3(e„-/3(||x(t„,)IU),0) + c-c7„-/i(zo),0) < MMtn)\\A)+Mc-\hiz)o\-an) 

(78) 

Notice that, according to the inductive hypothesis (Tj > Tj), the following holds 

||x(ti+i)||_4 < PiMU) ,Ti) + c-ai- h{zo) < ^i/3{MU) ||_^ , 0) + c ■ ■ h{zo) (79) 
for alH = 0, . . . , n. Then ([78]), ([79D, ([I8])-([20D imply that 



^0) 



x(t„+i) ||_^ , 0) < 0i(ei/3(||x(t„_i) ||_^ , 0) + c • an-i ■ h{zo)) +vi{c- \h{z)o\ ■ an) 

< 02(||x(t„_i)||^) + V2ic ■ \h{zo)\ ■ cr„_i) + Vi{c ■ \h{zo)\ ■ a^) 

n+l n+1 

< 0„+i(||xo||_4) + ^Vi{c ■ \h{zo)\an+l-i) < 0„+l(||xo||_4) + ^Vi{c ■ |/l(zo)|cr„+i_i) 

i=l 2=0 

According to Condition [3l term 

n+l 



0n+l(||xo||_4) + ^Vi{c - | /l(zo) | (T„+l- 



i=0 

is bounded from above by the sum 

Si(||xo|U) + 52(|/i(zo)|,c) 
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Therefore, monotonicity of 70,2, estimate fISUl) . and inequality fl2B]) lead to the following 
inequality 

70,2(a-V(l|x(tn+l lU), 0) + C ■ h{zo)) < 7o,2(5i(||xo|U) + ^2 ( | /l(zo) | , c) + C ■ h{zo)) < /l(Zo) Aq 

Hence, according to fl72]) . (1751) we have: 

y ^ (o-n+l - ^«+2) ^(zq) Ao/l(zo) _ ^ 

''^^ ~ 7o,iK+i) 7o,2(fT^+i/?(||x(t„+i)||_4,0) + c- /i(zo)) ~ "^^Ao/i(zo) 

Thus implication (17^ is proven. This implies that h{z{t)) G [0, /i(zo)] for all t > to and, 
consequently, that fl66|) holds. The theorem is proven. 

Proof of Lemma m As follows from the assumptions, h{z{t,ZQ)) is bounded. Assume it 
belongs to the following interval [a, h{zQ)], a < h{zQ). Therefore, as follows from ([8]) we can 
conclude that 

/■oo 

0< / 7i(l|x(r,xo)||_4)rfr</i(zo)-/i(z(t,zo))<oo (81) 

On the other hand, taking into account that h{z{t,Zo)) is bounded and monotone in t 
(every subsequence of which is this is again monotone) and applying the Bolzano- Weierstrass 
theorem we can conclude that h{z{t,ZQ)) converges in [a,h{zQ)]. In particular, there exists 
h G [a, H^Zq)] such that 

lim /i(z(t,zo)) = /i (82) 

According to the lemma assumptions, system Sa has steady-state characteristics. This means 
that there exists a constant x G IR+ such that 

lim ||x(t,Xo)|L = X (83) 



t—fOO 



Suppose that x > 0. Then it follows from (l83l) that there exists time instant ti < oo and 
some constant < 6 < x such that 



||x(t)||_4 >6Wt>ti 
Hence using flHTj) and noticing that 71 G /Ce we obtain 



00 > /i(zo) — /i(zo) > lim / 7i((5)(i' 



T 

r = 00 



Thus we obtained a contradiction. Hence, x = and, consequently, 



lim ||x(t)||^ = 

t—>-oo 



Then, according to the notion of steady-state characteristic in Definition [3] this is only 
possible ifJiE X^^(O)- The lemma is proven. 

Proof of Lemma\^ Analogously to the proof of Lemma[T]we notice that flSTj) holds. This, 
however, implies that for any constant and positive T the following limit 

rt+T 

lim / 7i(l|x(r)|U)rfr 
26 



exists and equals zero. Furthermore, h{z{t, zq)) G [0, H^zq)] for all t > Iq. Hence, there exists 
a time instant t' such that 

||x(t)||_4<c-/i(zo)+£, Vt>t', 
where e > is arbitrary small. Then taking into account (1311) we can conclude that 

rt+T pt+T 

\im 7i(l|x(r)|U)dr >^ Mr)\\j,dT = (84) 

Given that fl52]) holds, system ^ has the steady-state characteristic on average and that 
Xt(') has no zeros in the positive domain, limiting relation fl5^ is possible only if /i = 0. 
Then, according to (jH]), limf^oo ||x(t)||_^ = 0. The lemma is proven. 

Proof of CorollaryUl As follows from Theorem [H state x(t,xo) © z(t,zo) converges to 
the set Qa specified by f l21|) . Hence /i(z(t,zo)) is bounded. Then, according to ([HD, estimate 
(18T|) holds. This, in combination with condition implies that z(t, zq) is bounded. In 
other words 

x(i(;, xo) © z(t, zo) G V t > to 

where Q' is a bounded subset in M" x M"*. Applying the Bolzano- Weierstrass theorem we 
can conclude that for every point xq © zq G Q.y there is an a;-limit set a;(xo © zq) C Q' 
(non-empty) . 

As follows from C3) and Lemma [T] the following holds: 

lim /i(z(t,Zo)) Gx"'(0) 

t— >oo 

Therefore, given that h{-) G we can obtain that 

lim h{z{ti, zo)) = h{ lim z{ti, zq)) = /i(u;^(xo © zq)) G x"^(0) 

In other words: 

a;,(xo © Zo) C n^, = E M", z G M™| /i(z) G x"^(0)} 

Moreover 

u;^(xo © Zo) C = {x G M", z G M™| ||x||_^ = 0} 

According to assumption CI, the flow x(t,xo) © z(t, zq) is generated by a system of au- 
tonomous differential equations with locally Lipschitz right-hand side. Then, as follows from 
fl3j (Lemma 4.1, page 127) 

lim dist(x(t, xq) © z(t, zo), ^^(xo © zq)) = 

t— >oo 

Noticing that 

dist(x()f:, Xq) © z(t, Zq), ^^(Xo © Zq)) > dist(x(i(:, Xq), Q,a) + dist(z(t, Zq), Q,h) 

we can finally obtain that 

lim dist(x(t, xq), Qa) = 0, lim dist(z(t, zo), fth) = 

t— >oo t— ►oo 
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The corollary is proven. 

Proof of Corollary [H As follows from Theorem [T], the corollary will be proven if Condi- 
tions [T] - [3] are satisfied and also (^S^, fl2Bl) . and fl7r|) hold. In order to satisfy Condition [T] 
we select the following sequence S: 

S = {a,}Zo, a, = ^, KeR+, K>1 (85) 
Let us chose sequences T and S as follows: 

T = MZo, n = r\ (86) 

s = = r, (87) 

where r*, ^* are positive constants yet to be defined. Notice that choosing T as in (186!) 
automatically fulfills condition (1271) of Theorem [H On the other hand, taking into account 
(ITTl) . (l39l) and that /3t(t) is monotonically decreasing in t, this choice defines a constant ^* 
as follows: 

A(r*) < rA(o) < A(o), < r < 1 (88) 

Given that the inverse |3^^ exists, (HOjl . this choice is always possible. In particular, ( IHHl) will 
be satisfied for the following values of r*: 

r* > (rA(0)) (89) 

Let us now find the values for r* and ^* such that Condition [3] is also satisfied. To this 
purpose consider systems of functions $, T specified by equations (JTSl) . (fT9l) . Notice that 
function /3(s,0) in f|T8|) . f|T9l) is linear for system fl39|) 

/?(s,0) = s-A(0), 

and therefore the functions Pd, i(-), identity maps. Hence, T reduce to the following 

0,(s) =0,_i ■ e-/5(s,o) = r-A(o) -0,-1(5), J = 1,...,^ 

^- 0o(3) =A(0)-3 

^o(-5) = A(0) ■ S 

Taking into account (l85l) . fl90|) . flQll) let us exphcitly formulate requirements fl2Tl) . fl22l) in 
Condition [31 These conditions are equivalent to the boundedness of the following functions 

l|x(«o)IU-«O).^"(r-A(0)r; (92) 

'fl(o)^ + «^ + A(0) Ee|Mzo)l^r ■ ,ft(0))'- 

1=2 

= A(0)c|/i(zo)| + A(0)c|/i(zo)|«: (1 + X^/t^-^(r ■ A(0))*-^ 

\ i=2 

Boundedness of the functions -Bi(||xo||_4) and i?2(|/i(zo)|, c) is ensured if ^* satisfies the fol- 
lowing inequality 
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(93) 



for some < d < 1. Notice that k > 1, f3t{0) > 1 imply that ^* < 1 and therefore constant r* 
satisfying (l89l) will always be defied. Hence, according to (p2!) . (l93ll . the functions -Bi(||xo||^) 
and B2{\h{zo)\,c) satisfying Condition [3] can be chosen as 

i?i(||xo|U) = A(0)||xo|U; 52(IMzo)|,c) = A(0)-c-|Mzo)| + ^) (9^) 

In order to apply Theorem [T] we have to check the remaining conditions fl2S]) and fl2Bl) . 
This requires the possibility of factorization (fTOj) for the function 7o(-)- According to as- 
sumption (HT!) of the corollary the function 7o(-) is Lipschitz: 

|7o(-5)| < D^^o ■ \s\ 

This allows us to choose function 7o,i(-) and 7o,2(') as follows: 

7o,i(s) = s, 7o,2(s) = D^^o ■ s (96) 

Condition (1251) . therefore, is equivalent to solvability of the following inequality: 

1 1 ^ . 

> Ao (97) 



1^1 ^t+i I J, 



Taking into account inequalities ( l89l) . ( l94l) we can derive that solvability of 

implies existence of Aq > satisfying (|97|) and, consequently, condition fl25l) of Theorem [H 
Given that d < 1, k > 1 and /3t(0) > 1 a positive solution to (jnSD is always defined. Hence, 
the proof will be complete and the claim is non-vacuous if the domain 



I^7,0<(^A (^^JJ ^ ;5^(0)||xo|U + A(0)-C-|/l(zo)|(l + Y3^)+c|Mzo)| ^^^^ 

is not empty. T/ie corollary is proven. 

Proof of Corollary [3 It follows from Corollary [2] that state of the interconnection con- 
verges into Via for all initial conditions xq, zq satisfying (!99l) . In other words the following 
inequality should hold: 



D^,o (a(0) IIxoIU + A(0) ■ c ■ |/i(zo)| (^1 + + c|/i(zo)|^ 



< 



Hence, assuming that /i(zo) > we can rewrite ( llOOp in the following way: 
D^,o-A(0)||xo|U< 



(100) 



K// K \ \ 1 — a 
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Solutions to fllOip exist, however, if the inequahty 



or, equivalently 



K / / K \ \ \ — a 



Z,„„.c.(fl(0).(l + ^)+l).A-'(^)^<l (102) 



is satisfied. The estimate of the trapping region follows from (110 II) . 

Let us finally show that continuity of /i(z) implies that the volume of Vt^ is nonzero in 
© M™. For the sake of compactness we rewrite inequality (llOip in the following form: 

llxolU < C't^Izo), (103) 

where is a constant depending on n, /?t(0), and D^q. Given that (11021) holds we can 
conclude that > 0. According to (11031) . domain contains the following set: 

{xo e M", zo G W^l h{zo) >D,e M+, ||xo||^ < C^D,} 

Consider the following domain: f2x,7 = {xq G ]R"| ||xo||_4 < C^Dz}. Clearly, it contains 
a point Xo,i G M" : ||xo,i||_^ = "^"^^^^ . For the point Xo,i and for all £i G M" : ||£i|| < '^"'^'^ we 
have that ||xo,i + £i||^ = infqg^ ||xo,i + £i - q|| < infqg^{||xo,i - q|| + ||£i||} < On 
the other hand ||xo,i + £i||^ = infqg^ ||xo,i + £i - q|| > infqg^{||xo,i - q|| - ||£i||} > 



CD 

This implies that there exists a set of points xo,2 = xo,i + Si G M": ||xo,i — xo,2|| ^ 

Xo,2 ^ A, ||xo,2||_4 < C^D^. 

Consider now the following domain: Q2,-y = {zq G M™| /i(zo) > -Dz}. Let us pick 
Zo,i G Qz^^: /i(zo,i) = Because h{-) is continuous we have that 

V£:>0, 3 6>0: ||zo,i - Zo,2|| <S ^ |/i(zo,i) - ^(20,2)! < £ 

Let £ = Dz, then — Z^^, < /i(zo,i) — h{zQ 2) < and therefore h{zQ 2) > -D^. Hence there 
exists a set of points Zo,2 G M™: ||zo,i — Zo,2|| < Zo,2 G i^z,^. 
Consider the following set 

fixz,7 = |x' G M", z' G M™| ||xo,i - x'f + ||zo,i - z'f < r^, r = min 

For all xo,zo G fixz,7 we have that xq G ^^x,7, zq G ^2,7- Hence, inequality (11031) holds, and 
Xo © Zo G ^^7. The volume of the set fixz,7 is defined by the volume of the interior of a sphere 
in M""*"™ with nonzero radius. Thus the volume of ^7 D fixz,7 is also nonzero. The corollary 
is proven. 

Proof of Corollary^ Let A(r, Aq) be a solution of system (15T1) . Consider it as a function of 
variable r. Let us pick some monotone, strictly increasing function a such that the following 
holds 

r = o-(t), o- : M+ ^ M+ 

Given that tji^x) is dense in Qg, for any 6 E there always exists a vector Xg G Qx such 
that T]{Xg) = 6 + eg, where \\eg\\ is arbitrary small. Furthermore, A(r) is dense in Q\, hence 
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there is a point A* = A(r*,Ao), which is arbitrarily close to \g. Consider the following 
difference 

The function f(-) is locally bounded and t7(-) is Lipschitz, then 

\m - f (C, r7(A*))|| < Z^/||e,|| + = A, + A; 

where Ag is arbitrary small. Hence 

i|f(^, r7(A*)) - f(^,77(A(a(t))))l| < /^/N(A*) - r7(A(a(t)))|| + A^ + A, 
<D;-D,||A*-A(a(t))l|+A^ + Ae ^ ' 

Noticing that A* = A(r*, Aq) = A(cr(t*), Aq) and taking into account the Poisson stability of 
we can always choose A*(cr*,Ao) such that cr* > cr(to) = tq for any tq G M+. Hence, 
according to fllU4l) the following estimate holds: 

||f(^,r7(r))-f(|,ry(AKt))))|| <D;.D,|| T 5(A(a(r)))dr|| + A,^ + A, 

Ja(t) 

< Df ■ ■ max ||5(A)|||cr* - a{t)\ = V ■ \a* - a{t)\ + Af + Ag, V = DfD^- max ||5(A)|| 

(105) 

Denoting u(t) = f (^(t), 0) — f (^(t), 0) + e{t) we can now conclude that 

||u(t)|| < A, + A^ + ||f (^(t), 0) - fm, riiX*m +V-\a*- 

<A, + 2Af + Ae + Df\\e-ri{X*)\\+V-\a*-a{t)\ ^ ' 

Notice that due to the denseness of X(t, Aq) in Qx it is always possible to choose A* such 
that 

Dj\\0-riiX*)\\=Dj\\rjiXg)-rii\n\\<DfDjXe-rjiX*)\\<A, 
Hence, according to fll06p . we have 

oo,[to,t] ^ 2Aj + Ag + 5 + P ■ \\a* — o"(t)||oo,[to,t] 

where the term 6 > Ag + Ax can be made arbitrary small. 

Therefore Assumption [3] implies that the following inequality holds: 

II^WIU.(„, < Pit - to) ||x(to)IU,(„, +C-V- \\a* - (107) 

Let us now define a(t) as follows 

a{t)= j\m^{r))\\^^^^,^^dr (108) 

J to 

Moreover, let us introduce the following notation 



h{t) =a* - ait) = (y* - I 

Jtn 



7ll^(x(r))|U rfr 

to 
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then for all t', t > to, t > t' we have that 



hit')-h{t)= I 7ll^(x(r))|U^^^^^dr 



t' 



Taking into account equation (11041) . (11051) . equality 

^^^^1^ = ^5(A(a(t), Ao)) = 7||^(x(r))|U^^^^^ 5(A(a(t), Ao)), 

equation (11071) . and denoting Dx = cD, we can conclude that the following holds along the 
trajectories of fl52]) : 

/•* (109) 

h{to)-hit)= / 7ll^(x(r))|U^^^^^^ir 

J to 

Hence, according to Corollary [H the limit relation (13^ holds for all \h{to)\, l|x(to) lU^^^^^^ 
which belong to the domain 

d\\ ^ K. — 1 hi^to) 



K A(0) l|x(«„)IU^^, + A(0) • -Da ■ |A(((,)| (1 + T^) + Dx\hM\ 



for some ci < 1, k > 1. Notice, however, that ||x(t)||_^^^^ is always bounded as f(-) is 

Lipschitz in 6 and both 6 and are bounded (t7(-) is Lipschitz and X{t, Aq) is bounded 
according to assumptions of the corollary). Moreover, due to the Poisson stability of fl5T]) it 
is always possible to choose a point A* such that h(to) = a* is arbitrary large. Hence the 
choice of 7 in (11091) as ( l53l) suffices to ensure that h(t) is bounded. Moreover, it follows that 
h{t) converges to a limit as t — > 00. This implies that 7 f^^^ II^(''")IUa(m) converges as 
t 00, and, consequently, \{t, Aq) converges to some A' G Q\. Hence the following holds 

lim 6/(t) = e' 

t—tOO 

for some 6' G Qq. According to the corollary conditions, system (l50l) has steady state 
characteristics with respect to 6. Then, in the same way as in the proof of Lemma [H we can 
show that ( |5^ holds. The corollary is proven. 
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